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RELATED APPLICATIONS 

This application relates to, incorporates by reference, and claims priority from, 
United States Patent Application Serial Number 09/426,102, entitled, "Method and 
Apparatus for Content Personalization Over a Telephone Interface," filed October 22, 
10 1999, having inventors Hadi Partovi, Roderick S. Brathwaite, Angus M. Davis, Michael S. 
McCue, Brandon W. Porter, John Giannandrea, Eckart Walther, Anthony Accardi, and 
Zhe Li. 

BACKGROUND OF THE INVENTION 

Field of the Invention 

15 This invention relates to the field of electronic commerce. In particular, the 

invention relates to technologies for providing electronic commerce to users over a 
telephone interface. The invention also relates to identifying and registering users using 
telephone identifying information and personalizing the content, including the electronic 
commerce, presented to them using a profile selected using the telephone identifying 

20 information. 

Description of the Related Art 

The following describes various techniques used in telephone systems to provide 
enhanced user features. First, telephone identifying information will be discussed. Many 
telephone systems that support enhanced user features use telephone identifying 

25 information as a basic component. Then, a variety of example systems will be discussed 
that use telephone identifying information to provide enhanced user features will be 
discussed. 
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1 . Telephone Identifying Information 

The advent of automatic number identification (ANI) and calling number 
identification (CNID, CLID, or CID) within the North American Numbering Plan (NANP) 
has supported the creation of a number of services that use these pieces of telephone 
5 identifying information. Comparable systems may be used in other numbering plans and 
countries to support similar services. 

For example, when consumers receive credit cards in the mail, they have to call 
from their home telephone numbers to activate the cards. This is a typical use of ANI. In 
this instance, the credit card company matches the ANI information provided when the 
10 consumer calls to a previously provided telephone number. If the ANI matches the credit 
card company's records, the credit card company activates the card. 

2. Examples of Telephone System Personalization 

a. Personalization Generally 
With the advent of widely available real-time delivery of telephone identifying 
1 5 information such as ANI, a number of systems have been developed to use that 

information. One of the most common uses of ANI is for credit card activation. However, 
previous systems have been single purpose and typically require reference to other 
information provided separately. For example, credit card activation lines require 
separately provided information, e.g. your home phone number from the application. 

20 b. Building Personalized Content on the Web 

Some systems allow a user to build personalized content over the web. One 
example is the my Yahoo!™ service provided by Yahoo! of Santa Clara, California at 
<http;//my,yahoo.com/>. The personalized content pages developed on the web are 
delivered over the web to users accessing the pages with computers. These systems rely on 
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a usemame and password type system to identify the user rather than telephone identifying 
information and the delivery mechanisms is different. 

c. Interactive Personalization 
Still other systems allow users to personalize the content without entering special 
5 editing modes. For example, Amazon.com, of Seattle, Washington, keeps track of your 
purchases and preferences using cookies stored on a customer's web browser. 

Some telephone systems provide limited customization capabilities. For example, 
voice mail systems from Octel, a division of Lucent Technologies, allow a user to set 
preferences for prompt length, but those settings must be made explicitly by each user. 
1 0 Further, customization is limited to a few options like prompt length and outgoing 

message selection. The user can not redefine the way the voice mail system works for 
her/him beyond those narrow customization options. Further, these customizations do not 
affect the kinds of content and further the presentation is not selected based on telephone 
identifying information. 

15 d. Locale Selection 

Services such as Amtrak's 1-800-USA-RAIL reservation line use telephone 
identifying information to select an initial region. For example, if you call Amtrak's 
reservation number in the Northeastern United States, the system presents options relating 
to the Boston- Washington line. However, if you call from California, the system presents 

20 information about travel between San Francisco and Los Angeles. 

This can be accomplished by using the calling party's area code and/or exchange 
included with the telephone identifying information to select a region. The area codes 
and/or exchanges can then be paired to different scripts or default selections. For example, 
the area codes for New York City, e.g. "212", could be mapped to the Northeast Corridor 
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while San Francisco, ''415", could be mapped to the San Francisco-Los Angeles line. 
However this does not change the kind of content presented and it is not user-selected. 

e. Time Appropriate Information Presentation 

Several services provide information through the telephone. That information may 
5 be adapted based on the time of day or date. 

Some systems provide the information irrespective of the telephone identifying 
information. One example is Moviefone™, 777-FILM in most locales. Moviefone™ uses 
the current time at the called number to present appropriate information. The called 
number can be obtained using the dialed number identification service (DNIS). Thus, if 
10 you call Moviefone™ in the San Francisco Bay Area at 10 o'clock in the morning, only 
movies starting after 10 o'clock in the morning in the San Francisco Bay Area will be 
presented to you. However, if you call the Philadelphia Moviefone™, +1 (215) 222-FILM, 
from California, you will hear the Philadelphia movie times in Eastern Time. Thus, at 
10 o'clock in the morning Pacific Time, a call to the Philadelphia Moviefone™ will 
1 5 produce information for Philadelphia show times after one o'clock in the afternoon Eastern 
Time at Philadelphia area theatres. 

f. Targeted Advertising 

Some fi-ee long distance services provide customized advertising to support their 
services. One example is FreeWay'^^ offered by Broadpoint, of Landover, Maryland, 
20 <http://www.broadpoint.com/>. These services require an explicit user registration 
process, typically using a computer to access a web site, to provide the service with a 
profile. Once the profile is provided, the advertising is targeted to the particular person's 
explicitly provided demographic information. In some instances, the advertising may be 
targeted both based on the caller's demographics and their location. Thus, callers from the 
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San Francisco Bay Area with a particular explicit demographic profile may be presented 
one ad, while callers from outside the San Francisco Bay Area may be presented with 
another ad. Another, similar, service is offered on by phone by UAccess, Inc., 
<http://www.uaccessxom/>, by calling +1 (800) UACCESS, and provides consumers 
5 targeted advertising based on profile information they enter. 

g. Voice Character 

Most telephone systems have a small number of voice actors. Continuing with the 
example of Moviefone™, one actor performs all of the menus and prompts. Other systems 
may use different voice actors for different subsystems. 
1 0 These actors are typically selected on a system wide basis and as such, different 

voices, talents, speeds, characteristics, dialects, and other prosody aspects of the 
presentation are not user selectable. 

h. Purchase Recommendations 

Voice systems such as GALAXY from the Massachusetts Institute of Technology 
1 5 (MIT), Cambridge, Massachusetts, have been adapted to provide information about 
purchasing decisions for used cars. For example, GALAXY has been used to allow for 
interactive browsing of automobile classified ads. These voice systems are problem 
domain specific. Further, the systems are designed to locate vehicles matching a particular 
set of criterion, rather than making actual reconmiendations. 
20 Other systems are web based. For example, Ameizon.com will make book 

suggestions for users connected to the web via a computer. However, those suggestions 
are limited to a particular site, e.g. Amazon.com. 
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i. Voice Login 

Most telephone systems require a user to explicitly identify herself/himself by 
using a combination of a login identifier, e.g. credit card number, account nxmiber, etc., 
and a personal identification number (PIN), Some systems abbreviate this process by 
5 allowing a user calling from a particular phone to shortcut this process slightly. For 

example, callers using a phone number associated with a particular credit card might only 
be asked to enter the last four digits of their credit card number together with their billing 
zip code instead of all sixteen digits of the card number. Other products such as Nuance 
Verifier™ from Nuance Communications, Menlo Park, California, support voice login 
10 capabilities, e.g. you just speak instead of entering a password. 

i. Initial Profile Generation from Database Lookups 
Most systems that provide information over the telephone require users to 
explicitly answer one or more questions in one form or another, e.g. over the phone, the 
web, and/or in written form. These questions form a demographic and/or psychographic 
1 5 profile for the user. All of these systems require the user to explicitly provide her/his 
profile information. 

3. Telephone Commerce S ystems 

Prior techniques for telephone commerce have required users to explicitly identify 
themselves and provide credit card, or other billing information, for each transaction. For 
20 example, Moviefone™ allows consumers to purchase tickets for movies via a telephone 
interface. To purchase the tickets, the user must explicitly key her/his credit card 
information into the Moviefone'^^ system. For verification purposes, Moviefone™ 
requires the presence of the credit card when the tickets are picked up at the theatre. 
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Other automated systems operate similarly. Some systems record a user speaking 
her/his address either on tape, or in a computer memory, to allow for entry of the user's 
address information. These systems require offline processing by humans to key the voice 
entered data for order completion. Examples of these types of systems may include 
5 telephone operator base commerce, e.g. mail-order catalogs, and telephone based stock 
trading, 

SUMMARY OF THE INVENTION 

A voice portal supporting telephone to web server commerce is described. The 
voice portal allows users to access web servers using a hypertext transfer protocol 

10 (HTTP), optionally including the use of a secure sockets layer (SSL) protocol, to complete 
commercial transactions. This allows the voice portal to complete transactions at 
non- voice enabled electronic commerce sites through a data connectivity engine 
supporting access to standard electronic commerce web sites. 

Some embodiments of the invention employ a one word commerce model. This 

15 model abstracts the particular commerce model used by electronic commerce vendors, e.g. 
web site A uses a shopping cart model, web site B uses a one-click buy model, web site C 
uses a third purchase model. The one word commerce model permits a purchaser to 
identify a product and then signal her/his purchase intentions with a single word, phrase, 
or touch-tone command. Thus, the particular vendor's commerce - and fulfillment - 

20 model is irrelevant. 

The voice portal can then complete the transaction by supplying the electronic 
commerce vendor all necessary information about the purchaser to complete the 
transaction. For example, the voice portal can provide the purchaser's address, telephone 
number, electronic mail address, credit card information, etc. 
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As needed, the voice portal can prompt the purchaser for information. For 
example, the first time a purchaser uses the voice portal, her/his shipping address may not 
be known to the voice portal. The voice portal can maintain a record of this information 
apart from a particular vendor. Thus, information need not be repeatedly collected and can 
5 be automatically re-used for future purchases at different vendors. 

Further, embodiments of the invention can provide a record of commerce 
transactions in the form of voice receipts. The voice receipts can include a vendor specific 
tracking and status information. For example, the voice receipt may include tracking 
information such as the shipping status from the web site of an electronic commerce 
1 0 vendor as well as details of the purchase. Similarly, the voice receipt for a stock trade 
request could include the time of execution, the execution price, and/or other merchant 
specific information. The voice receipts can be reviewed over the telephone interface 
and/or from a web site coupled to the voice portal. 

Selective password protection of the commerce features are afforded by some 
1 5 embodiments of the invention to reduce the likelihood of unauthorized transactions. For 
example, some embodiments require the user to provide a password, or other identification 
number, to the voice portal for the first commerce transaction of each telephone session. 

Additionally, embodiments of the invention may employ a range of personalization 
techniques to assist purchasers in selecting items as well as in the presentation of 
20 suggested items. For example, the voice portal may supply customized commerce 

suggestions based on the time of day, the time of the year, special events in the user's 
locale, etc. 
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BRIEF DESCRIPTION OF THE FIGURES 

Fig. 1 illustrates a system including embodiments of the invention used to provide 
personalized content to users of telephones according to telephone identifying information. 

Fig, 2 illustrates the components of a voice portal supporting personalized content. 
5 Fig, 3 is a process flow diagram supporting personalization and registration of and 

for users accessing a voice portal over a telephone interface. 

Fig. 4 is a process flow diagram for personalizing a voice portal over a web based 
interface. 

Fig. 5 is a process flow diagram for providing personalized content according to 
1 0 some embodiments of the invention. 

Fig. 6 is a process flow diagram for conducting electronic commerce over a 
telephone interface according to some embodiments of the invention. 
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DETAILED DESCRIPTION 

A. Introduction 

A voice portal supporting electronic commerce over a telephone interface is 
described. The voice portal allows users of telephones, including cellular telephones, to 
5 access a voice portal by dialing a phone number to purchase goods and services. The 
information provided over the voice portal may come from the World Wide Web 
(WWW), databases, third parties, and/or other sources. 

The term voice portal refers to the capability of various embodiments of the 
invention to provide coromerce capabilities over a telephone interface to a caller. The 
10 voice portal can receive dual-tone multi-frequency (DTMF or touch-tone) commands as 
well as spoken commands to further control the content presented and direct commerce 
transactions as well as the manner of presentation. The term audio request, or input, is 
used to refer to either a voice or touch-tone input, or a combination of the two types of 
input. 

1 5 Embodiments of the invention use telephone identifying information to personalize 

caller interactions with the voice portal. This allows the system to present highly 
customized information to each caller based on a personal profile the system associates 
with the telephone identifying information. 

The invention will be described in greater detail as follows. First, a number of 

20 definitions useful to understanding the invention are presented. Then, the hardware and 
software architecture is presented in the System Overview. Then, a series of sections 
describe the various personalization features provided by different embodiments of the 
invention. Then, a section describes the electronic commerce capabilities of the system. 
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B. Definitions 

1 . Telephone Identifying Information 

For the purposes of this appUcation, the term telephone identifying information 
will be used to refer to ANI information, CID information, and/or some other technique 
5 for automatically identifying the source of a call and/or other call setup information. For 
example, telephone identifying information may include a dialed number identification 
service (DNIS), Similarly, CID information may include text data including the 
subscriber's name and/or address, e.g. "Jane Doe". Other examples of telephone 
identifying information might include the type of calling phone, e.g. cellular, pay phone, 
1 0 and/or hospital phone. 

Additionally, the telephone identifying information may include wireless carrier 
specific identifying information, e.g. location of wireless phone now, etc. Also, signaling 
system seven (SS7) information may be included in the telephone identifying information. 

2. User Profile 

15 A user profile is a collection of information about a particular user. The user 

profile typically includes collections of different information as shown and described more 
fully in connection with Figure 6. Notably, the user profile contains a combination of 
explicitly made selections and implicitly made selections. 

Explicitly made selections in the user profile stem from requests by the user to the 

20 system. For example, the user might add business news to the main topic list. Typically, 
explicit selections come in the form of a voice, or touch-tone command, to save a 
particular location, e.g. "Remember this", "Bookmark it", "shortcut this", pound (#) key 
touch-tone, etc., or through adjustments to the user profile made through the web interface 
using a computer. 
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In contrast, implicit selections come about through the conduct and behavior of the 
user. For example, if the user repeatedly asks for the weather in Palo Alto, California, the 
system may automatically provide the Palo Alto weather report without further prompting. 
In other embodiments, the user may be prompted to confirm the system's implicit choice, 
5 e.g. the system might prompt the user "Would you like me to include Palo Alto in the 
standard weather report from now on?" 

Additionally, the system may allow the user to customize the system to meet 
her/his needs better. For example, the user may be allowed to control the verbosity of 
prompts, the dialect used, and/or other settings for the system. These customizations can 
1 0 be made either explicitly or implicitly. For example if the user is providing commands 
before most prompts are finished, the system could recognize that a less verbose set of 
prompts is needed and implicitly set the user's prompting preference to briefer prompts. 

3. Topics and Content 

A topic is any collection of similar content. Topics may be arranged hierarchically 
15 as well. For example, a topic might be business news, while subtopics might include stock 
quotes, market report, and analyst reports. Within a topic different types of content are 
available. For example, in the stock quotes subtopic, the content might include stock 
quotes. The distinction between topics and the content within the topics is primarily one of 
degree in that each topic, or subtopic, will usually contain several pieces of content. 

20 4. Qualified 

The term qualified as it is used in this application refers to whether or not a 
particular user being presented an advertisement, or other material, meets the demographic 
and/or psychographic profile requirements for that advertisement, or content. For example, 
a San Francisco-based bookstore might request that all listeners to its advertisement be 



C:\NRPORTBL\PALibl\DRH\l 104973.4 



14 



Attorney Docket Number: 22379-701 



located in a particular part of the San Francisco Bay Area. Thus, a user of the system 
would be qualified if she lived in the designated part of the San Francisco Bay Area. 

Different embodiments of the invention may qualify users of the system according 
to different requirements. For example, in some instances advertising, or content, is 
5 qualified solely based on telephone identifying information. In other embodiments the 

telephone identifying information is used in conjunction with other information such as an 
associated user profile, a reverse telephone number lookup for locale demographics, 
and/or other information. 

5. Locale 

1 0 As used in this application, the term locale refers to any geographic area. The 

geographic area may be a neighborhood, a city, a county, a metropolitan region, a state, a 
country, a continent, a group of countries, and/or some other collection of one or more 
geographic areas, e.g. all United State major metropolitan areas. 

For this reason, a single user of the system may be considered to be in several 

15 locales. For example, a caller from Palo Alto, California, might be in the Palo Alto locale, 
a Silicon Valley locale, a San Francisco Bay Area locale, a Northern California locale, a 
California state locale, and a United States locale. 

Thus, the telephone identifying information for a single telephone number can be 
mapped to a number of system-defined locales. 

20 6. Voice Character 

The term voice character as it is used in this application refers to all aspects of 
speech pronunciation including dialect, speed, volume, gender of speaker, pitch, language, 
voice talent used, actor, characteristics of speech, and/or other prosody values. Users can 
adjust the voice character of the system by changing their voice character settings. 
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For example, an elderly user could select voice character settings that provide 
louder volume and slower speech. Similarly, a caller from the South could adjust the voice 
character settings to support a Southern dialect. 

7. Demographic and Psvchographic Profiles 
5 Both demographic profiles and psychographic profiles contain information relating 

to a user. Demographic profiles typically include factual information, e.g. age, gender, 
marital status, income, etc. Psychographic profiles typically include information about 
behaviors, e.g. fun loving, analytical, compassionate, fast reader, slow reader, etc. As used 
in this application, the term demographic profile will be used to refer to both demographic 
1 0 and psychographic profiles. 

C. System Overview 

First, the hardware and software architecture of a system including an embodiment 
of the invention will be described with reference to Figures 1-2. Figure 1 illustrates a 
system including embodiments of the invention used to provide personalized content to 

15 users of telephones according to telephone identifying information. The system of Figure 1 
can be used to allow users of standard telephones and cellular telephones to access a voice 
portal with personalized content from their telephones. 

The following lists the elements of Figure 1 and describes their interconnections. 
Figure 1 includes a telephone 100, a cellular telephone 1 01 , a computer 102, a telephone 

20 network 104, an Internet 106, a telephone gateway 107, a web server 108, a voice portal 
1 10, a shared database 1 12 and a personalized site 130. The cellular telephone 101 and the 
telephone 100 are coupled in communication with the telephone network 104. The 
telephone network 104 is coupled in communication with the telephone gateway 107. The 
telephone gateway 107 is coupled in communication with the voice portal 110. The 
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computer 102 is coupled in communication with the Internet 106. The Internet 106 is 
coupled in communication with the web server 108. The voice portal 110 and the web 
server 108 are coupled in communication with the shared database 1 12, The personalized 
site 130 is coupled in communication with the Internet 106. 
5 The following describes each of the elements of Figure 1 in greater detail. The use 

of each of the elements will be described further in conjunction with the sections 
describing the personalization features. 

The telephone 100 and the cellular telephone 101 are two different telephone 
interfaces to the voice portal 1 10. The telephone 100 and the cellular telephone 101 may 

10 be any sort of telephone and/or cellular telephone. For example the telephone 100 or the 
cellular telephone 101 may be a land line phone, a PBX telephone, a satellite phone, a 
wireless telephone, and/or any other type of communication device capable of providing 
voice communication and/or touch-tone signals over the telephone network 104. However, 
any audio signal carrying interface could be used. 

1 5 The telephone network 1 04 may be the public switched telephone network (PSTN) 

and/or some other type of telephone network. For example, some embodiments of the 
invention may allow users with a voice over Internet Protocol (IP) phone to access the 
voice portal 110. The telephone network 104 is coupled to the telephone gateway 107 that 
allows the voice communications and/or touch-tone signals from the telephone network 

20 104 to reach the voice portal 1 10 in usable form. Similarly, the telephone gateway 107 
allows audio signals generated by the voice portal 1 10 to be sent over the telephone 
network 104 to respective telephones, e.g. the telephone 100. The telephone network 104 
generally represents an audio signal carrying network. 

The computer 102 is a computer such as a personal computer, a thin client 

25 computer, a server computer, a handheld computer, a set top box computer, and/or some 
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other type of visual web browsing device. The computer 102 is coupled in communication 
with the Internet 106, e.g. by a dial-up connection, a digital subscriber loop (DSL), a cable 
modem, and/or some other type of connection. This allows the computer 102 to 
communicate with the web server 108, The computer 102 typically provides a visual 
5 interface to the WWW and the web server 108 using web browsing software such as 
Internet Explorer'^^ from Microsoft Corporation, Redmond, Washington. 

Both the web server 108 and the voice portal 110 are capable of communicating 
with the shared database 1 12 to register users, build personal profiles implicitly and/or 
explicitly as will be described more fully below. The database 112 stores profiles for each 

10 user based on an association between one or more pieces of telephone identifying 

information and a particular user. Thus, the database may have a profile for a user Sarah 
Smith that is keyed to her home telephone number, e.g. 650-493-####, Additionally, Sarah 
could associate other numbers, e.g. work, cellular, etc., with her profile either implicitly, 
e.g. by repeatedly calling the voice portal 110 from those numbers, or explicitly, e.g. by 

1 5 adding those numbers to the system directly. 

In some embodiments, an existing profile for a web-based portal is adapted for use 
by the voice portal 1 1 0 by associating one or more telephone numbers with the existing 
profile as stored in the shared database 1 12. In these embodiments, the existing profile 
may be fiirther modified for use with the voice portal 1 10 to allow for different 

20 preferences between the web and the voice interfaces. 

The call flow arrows 1 14-122 shown on Figure 1 will be described in greater detail 

below. 

Figure 2 illustrates the components of a voice portal supporting personalized 
content. This could be used to support the voice portal 110 and provide personal content as 
25 described above. 
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The following lists the elements of Figure 2 and describes their interconnections. 
The voice portal 110 is coupled in communication with the telephone gateway 107. The 
voice portal 110 includes a call manager 200, an execution engine 202, a data connectivity 
engine 220, an evaluation engine 222 and a streaming engine 224. Additionally Figure 2 
5 includes elements that may be included in the voice portal 110, or which may be separate 
from, but coupled to, the voice portal 110. Thus Figure 2 also includes a recognition server 
210, a text to speech server 214, an audio repository 212, the shared database 1 12, a 
database 226, the Internet 106, a database 228 and a web site 230. The call manager 200 
within the voice portal 1 10 is coupled to the execution engine 202. The execution engine 

10 202 is coupled to the recognition server 210, the text to speech server 214, the audio 

repository 212, data connectivity engine 220, the evaluation engine 222 and the streaming 
engine 224. The data connectivity engine 220 is coupled in communication with the 
shared database 1 12, the database 226 and the Internet 106. The Internet 106 is coupled in 
communication with database 228 and the web site 230. 

15 The following describes each of the elements of Figure 2 in greater detail. The use 

of each of the elements will be described further in conjunction with the sections 
describing the personalization features. 

Typically, the voice portal 1 1 0 is implemented using one or more computers. The 
computers may be server computers such as UNIX workstations, personal computers 

20 and/or some other type of computers. Each of the components of the voice portal 110 may 
be implemented on a single computer, multiple computers and/or in a distributed fashion. 
Thus, each of the components of the voice portal 1 10 is a functional unit that may be 
divided over multiple computers and/or multiple processors. The voice portal 110 
represents an example of a telephone interface subsystem. Different components may be 

25 included in a telephone interface subsystem. For example, a telephone interface subsystem 
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may include one or more of the following components: the call manager 200, the 
execution engine, the data connectivity 220, the evaluation engine 222, the streaming 
subsystem 224, the audio repository 212, the text to speech 214 and/or the recognition 
engine 210. 

5 The call manager 200 is responsible for scheduling call and process flow among 

the various components of the voice portal 1 10. The call manager 200 sequences access to 
the execution engine 202. Similarly, the execution engine 202 handles access to the 
recognition server 210, the text to speech server 214, the audio repository 212, the data 
connectivity engine 220, the evaluation engine 222 and the streaming engine 224. 
10 The recognition server 210 supports voice, or speech, recognition. The recognition 

server 210 may use Nuance 6™ recognition software from Nuance Communications, 
Menlo Park, California, and/or some other speech recognition product. The execution 
engine 202 provides necessary grammars to the recognition server 210 to assist in the 
recognition process. The resuUs from the recognition server 210 can then be used by the 
1 5 execution engine 202 to further direct the call session. Additionally, the recognition server 
1 10 may support voice login using products such as Nuance Verifier™ and/or other voice 
login and verification products. 

The text to speech server 214 supports the conversion of text to synthesized speech 
for transmission over the telephone gateway 107. For example, the execution engine 202 
20 could request that the phrase, "The temperature in Palo Alto, California, is currently 58 

degrees and rising" be spoken to a caller. That phrase would be translated to speech by the 
text to speech server 214 for playback over the telephone network on the telephone (e.g. 
the telephone 100). Additionally the text to speech server 214 may respond using a 
selected dialect and/or other voice character settings appropriate for the caller. 
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The audio repository 212 may include recorded sounds and/or voices. In some 
embodiments the audio repository 212 is coupled to one of the databases (e.g. the database 
226, the database 228 and/or the shared database 1 12) for storage of audio files. Typically, 
the audio repository server 212 responds to requests from the execution engine 202 to play 
5 a specific sound or recording. 

For example, the audio repository 212 may contain a standard voice greeting for 
callers to the voice portal 1 10, in which case the execution engine 202 could request 
play-back of that particular sound file. The selected sound file would then be delivered by 
the audio repository 212 through the call manager 200 and across the telephone gateway 
10 107 to the caller on the telephone, e.g. the telephone 1 00. Additionally, the telephone 

gateway 107 may include digital signal processors (DSPs) that support the generation of 
sounds and/or audio mixing. 

The execution engine 202 supports the execution of multiple threads with each 
thread operating one or more applications for a particular call to the voice portal 110. 
15 Thus, for example, if the user has called in to the voice portal 1 10, a thread may be started 
to provide her/him a voice interface to the system and for accessing other options. 

In some embodiments of the invention an extensible markup language (XML)- 
style language is used to program applications. Each application is then written in the 
XML-style language and executed in a thread on the execution engine 202. In some 
20 embodiments, an XML-style language such as VoiceXML from the VoiceXML Forum, 
<http://www.voicexmLorg/>, is extended for use by the execution engine 202 in the voice 
portal 110. 

Additionally, the execution engine 202 may access the data connectivity engine 
220 for access to databases and web sites (e.g. the shared database 1 12, the web site 230), 
25 the evaluation engine 222 for computing tasks and the streaming engine 224 for 
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presentation of streaming media and audio. The streaming engine 224 may allow users of 
the voice portal 1 10 to access streaming audio content, or the audio portion of streaming 
video content, over the telephone interface. For example, a streaming media broadcast 
from ZDNet™ could be accessed by the streaming engine 224 for playback through the 
5 voice portal. 

The data connectivity engine 220 supports access to a variety of databases 
including databases accessed across the Internet 106, e.g. the database 228, and also access 
to web sites over the Internet such as the web site 230. In some embodiments the data 
connectivity engine can access standard query language (SQL) databases, open database 

10 connectivity databases (ODBC), and/or other types of databases. The shared database 112 
is represented separately from the other databases in Figure 2; however, the shared 
database 112 may in fact be part of one of the other databases, e.g. the database 226. Thus, 
the shared database 1 12 is distinguished from other databases accessed by the voice portal 
1 10 in that it contains user profile information. 

15 Having described the hardware and software architecture supporting various 

embodiments of the invention, the various personalization features provided by different 
embodiments of the invention will now be described. 

D. Telephone Driven Profile Building 

Turning to Figure 3, the process of creating a profile using a telephone interface 
20 will be described. This process will be described with reference to the call flow arrows 
shown on Figure 1 as well. 

The voice portal 1 10 is able to flexibly handle multiple callers from a single 
telephone, e.g. Tom and Dick are roommates and both call from 650-493-####. Similarly, 
the voice portal 1 10 is able to handle a single caller that uses multiple telephones, e.g. 
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Tom has a cell phone 650-245-####, his home phone 650-493-####, and a work phone 
408-301-####. The manner in which the voice portal 110 can handle some of the above 
situations will be discussed throughout. In the example used while describing Figure 3, the 
process will be described using a caller Jane Smith as an exemplary caller who has never 
5 registered with the voice portal 110 from any telephone and an exemplary caller John Doe 
who has previously called the voice portal 110 from his telephone 100. 

First, at step 300, telephone identifying information is received. This is shown in 
Figure 1 by call flow arrow 114 representing the transfer of telephone identifying 
information through the telephone gateway 107 to the voice portal 110. This step occurs 
10 after a user has placed a call to the voice portal 110 with a telephone, e.g. the telephone 
100. 

Next, at step 302, a determination is made as to whether the telephone identifying 
information corresponds to a known profile, e.g. is the user registered? Some examples 
may be illustrative. If Jane Smith uses the cellular telephone 101 to call the voice portal 

15 1 1 0 for the first time, her telephone identifying information will not be associated with any 
existing unique profile in the shared database 1 12. Therefore, at step 302, the 
determination would be made that she is not registered and the process would continue at 
step 304. In contrast, John Doe has previously called the voice portal from the telephone 
100 and so his telephone identifying information will be associated with a profile in the 

20 shared database 112 and the process would continue at step 306. 

If, the telephone identifying information is not associated with an existing profile 
in the shared database 1 12, a new profile is created at step 304. The new profile may be 
initialized using a variety of information derived from the telephone identifying 
information and/or predetermined values for the voice portal 110. Thus, for example, 

25 when Jane Smith calls for the first time from the cellular telephone 101, an initial profile 
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can be created using the calling nxamber, e.g. 650-493-####, included in the telephone 
identifying information to select initial profile settings. The call flow arrow 116 shows this 
process on Figure 1 . The use of the telephone identifying information to create an initial 
profile is discussed below in the section "Automatic Profile Initialization". 
5 In some embodiments, the profile is not initialized using the telephone identifying 

information. In other embodiments, the user may be explicitly queried by the voice portal 
1 10 to create one or more components of the initial profile, e.g. "Please speak your first 
name", to allow for more personalized prompting by the voice portal 110. Once a profile is 
created, the process continues at step 306. 

10 At step 306, the profile is retrieved from the shared database 1 12 as shown by the 

call flow arrow 118. The profile can be updated throughout the call based on the user's 
behavior and actions — implicit preferences ~ as well as explicit requests from the user to 
customize the voice portal 110. Once a profile is selected at step 306, the personalized 
content can be presented to the user as shown by the call flow arrow 122 in Figure 1 . 

15 For example, John Doe, who is calling from the telephone 100, already has a 

profile in the shared database 112. That profile may indicate that John prefers a southern 
dialect and likes to hear a quick stock market report immediately on call in. Thus, for 
John, his telephone identifying information serves to log him directly into the system and 
trigger the personalized behavior unique to him: a quick stock market report in a southern 

20 dialect. In contrast, a different caller, Sarah Brown, from a different telephone will be 
provided different personalized content based on that telephone identifying information. 

The voice portal may support multiple callers from a single telephone. For 
example, Sarah Brown and John Doe may both use the telephone 100 to call the voice 
portal 1 10. In the case where two or more profiles are identified with the same telephone 
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identifying information, the voice portal may prompt for a password or other unique 
identifier, either as voice or touch-tone, to select among the profiles. 

However, as a general matter, the voice portal is configured to minimize the need 
for a caller to provide a password. Thus, during a single call session, the caller is typically 
5 only asked to provide her/his password a single time. However, some embodiments of the 
invention may require that a password always be used to complete commercial 
transactions and/or after the passage of a predetermined period, e.g. ten minutes since last 
password prompt. In some embodiments, the user may adjust her/his profile to allow login 
without a password for playback features. 

10 Also, a single profile can be associated with multiple calling numbers. For 

example, the user Jane Doe could specify that both the telephone 100 and the cellular 
telephone 101 should be associated with her profile. Similarly, if Jane calls from a new 
telephone, e.g. pay phone, she can provide her existing telephone number and her 
password to access her profile. In some embodiments, whenever the user calls from a new 

15 telephone number, she/he is prompted as to whether to remember the number for future 
use. In some embodiments, additional telephone identifying information, e.g. this is a pay 
phone, is used so that the caller is not prompted to associated telephone numbers that are 
likely to be single time uses with her/his profile. Similarly, voice verification may be used 
to recognize a caller's voice instead of, or in addition to, using a password or other 

20 identification number. 

Typical events that would require a password, or that the user be authenticated 
previously with a password, might include adding and removing items from the user 
profile through explicit commands as well as requests for specific personal information, 
e.g. that user's stock portfolio, bank account balances, etc. 
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It is not necessary for callers to the voice portal 1 10 to explicitly specify their 
preferences using this embodiment of the invention. The callers' behaviors and actions are 
used by the voice portal 1 1 0 to adopt implicit preferences, sometimes after receiving 
confirmation. For example, behaviors and actions reflecting repeated access to a content in 
5 a particular topic, or a particular topic, may cause the voice portal 1 10 to automatically 
include the repeatedly requested content in the default message. 

For example, if a caller from New York City repeatedly asks for the weather in San 
Francisco, the system can add the San Francisco weather to the standard weather report. 
Alternatively, the system may request confirmation before adding the weather report, e.g. 

10 "Would you like me to include San Francisco in the standard weather report?" Similarly, 
at the level of topics, users who repeatedly ask for information about business related 
issues may find that the system will adjust the main menu to include business. Similarly, if 
that same user never asks for sports scores, that option may drop off the main menu. In 
some embodiments, the system may ask for confirmation before modifying the menu 

1 5 choices, or the system may notify the user of a modification and/or allow a user to 

review/change past modifications. As a result, the structure and content of the call may 
change, e.g. San Francisco weather will be announced at the beginning of future calls and 
sports information may be omitted. 

Through the use of this process, the need for a specialized editing mode of the type 

20 seen on customizable web portals is reduced. The user's actions and behaviors shape the 
options presented to her/him. Thus, reducing the need to explicitly pick topics and/or 
content in an editing mode. However, some embodiments of the invention may allow for 
explicit profile creation in an editing mode over the web, see below, and/or over the 
telephone. Also, users are typically permitted to add and remove topics and/or items at 
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will with explicit commands, e.g. "Remember this", "Remove", "Add to my stock list", 
etc. 

E. Web Driven Profile Building 

Turning to Figure 4, the process of modifying a profile for use over a telephone 
5 interface over the web will be described. This process will be described with reference to 
the call flow arrows shown on Figure 1 as well. 

The process shown in Figure 4 assumes that a profile has already been created, e.g. 
by calling for the first time as described above. However, in some embodiments of the 
invention, users may create profiles using the web interface by providing the telephone 
10 identifying information for their primary calling phone number and a password. As is the 
case with the telephone registration process described in step 304, the telephone 
identifying information provided, here the primary calling phone number, can be used to 
create the initial profile. 

Starting at step 400, the profile is accessed using a computer (e.g. the computer 
15 1 02) via a web interface. The web interface is provided by a web server (e.g. the web 
server 108) and allows for access to the shared database 1 12 as shown by the call flow 
arrow 120. 

Once the user has signed in to access her/his profile on the computer, she/he can 
manually identify content and topics to build her/his profile at step 404. This can be 
20 supported by allowing the user to specify topics from a list of topics and then specifying 
per topic content from a list of content. For example, the topics might include business, 
sports, news, entertainment, and weather, to name a few. The user could include weather, 
news, and business in her/his main menu and then further customize the specific content to 
be presented within those topics. For example, within weather, the user might select the 
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specific cities she/he wants listed in her/his weather menu and/or the cities for which the 
weather is automatically played. 

Alternatively, at step 402, the user can identify a web location with personalized 
content to use in building her/his profile, e.g. a uniform resource indicator (URI). For 

5 example. Figure 1 includes the personalized site 130. The personalized site 130 could be a 
customized portal web page, e.g. my Yahoo!, My Netscape, etc., a home page the user 
herself/himself has designed, and/or any other web page that includes content of interest to 
the user. The user can identify the personalized site with a uniform resource indicator 
(URI), including a login identifier and password if necessary, e.g. for my Yahoo! The 

1 0 personalized site 1 30 can then be accessed and the pertinent user preferences, e.g. news, 
stocks, selected. Taking the example of a customized portal site, the main topics selected, 
e.g. horoscopes, and the content within, Sagittarius, could be adopted. However, the voice 
portal 110 may present its own content for that particular item, e.g. the version of the 
Sagittarius horoscope on the voice portal 1 10 not the version from the personalized site 

15 130, 

The processes of step 402 and step 404 can be used together allowing a user to 
quickly transfer preferences from a web portal to her/his voice portal while still supporting 
explicit personalization. 

Alternatively, in some embodiments of the invention, an existing web portal profile 

20 is voice enabled for use by a voice portal through the association of telephone identifying 
information with the existing web portal. In this embodiment, at step 402, the telephone 
identifying information, e.g. the primary calling number, is associated with an existing 
web profile, e.g. my Yahoo! profile, stored in the shared database 1 12 and that existing 
web profile is then usable from the voice portal 110 either using voice or touch-tone 

25 commands. 
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Additionally, web sites like the personalized site 130 may be accessed using the 
voice portal 1 1 0 in some embodiments of the invention through the use of the data 
connectivity engine 220 as shown in Figure 2. 

F. Profile Building Via Other Web Sites 
5 Some embodiments of the invention may allow users of the voice portal 1 10 to add 

to their profile from other web sites. For example, if a user of the computer 102 is 
accessing a web site (e.g. the personalized site 130), the web site might include a link like 
"Add this to your voice portal." Thus, for example, from a service such as MapQuest™ or 
Ameritrade™, the user could click on a link to add a particular piece of content or a 

1 0 particular topic to their portal for the voice portal 110. 

For example, a user could add her/his "QQQ" stock symbol to her/his profile on 
the voice portal 110 even though the voice portal 110 may be operated independently of 
the particular web site. 

This type of web based profile building allows for widespread profile building for 

15 the voice portal 110 from a variety of Internet sites. Also, in some embodiments, the web 
browser software on the user's computer (e.g. the computer 102) can support an option to 
add a bookmark to the user's profile stored in the shared database 1 12 for the voice portal 
110. For example, a menu option in the browser on the computer 102 might include "Add 
Page to Voice Portal Shortcuts" and upon selecting that menu option, the current web page 

20 would be added to the user's profile on the voice portal 110. 

This would typically be accomplished by accessing a URI on the web server 108 
that included the information to be added. At that point, the web server 108 might ask for a 
primary calling phone number and/or a password. In some embodiments, a cookie stored 
by the browser on the computer 102 may be used to obviate one or both of these steps. 
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After the user provides the information, or it is accepted automatically, a confirmation 
page may be shown including a return link to the originating web page. Several example 
URI's for adding content are shown below: 



<http://www.voiceportal.coin/addxgi?topic=stock%20quote&content==QQQ> 

<http;//www.voiceportBlxom/addxgi?shortcut^MapQuest^ref==www.mapquestxom^^^ 

<http://www.voiceportalxom/addxgi?shortcut=myYahoo&ref=myyahooxom/voice^ 



These examples are illustrative of the various types of URI's that can be placed as links on 
web sites to allow users of the voice portal 11 0 to further customize their profile. 

G. Locale Based Personalization 

1 0 Turning to Figure 5, the basic personalization framework used by several 

embodiments of the invention is presented. At step 500, a request is made for content, or a 
topic. Then one or more of steps 502-510 take place, in parallel or sequence, and then the 
content is presented at step 512. Which of steps 502-510 occur for a given request may be 
determined based on the topic or content requested. For example, step 504 can be omitted 

1 5 when non-time dependent information is presented. 

Turning to step 502, the customization of content based on the calling locale. The 
telephone identifying information includes information about the caller's locale 
independent of any user provided registration information. This information can be 
derived from telephone routing tables that provide a descriptive name for each area 

20 code/exchange combination within the North American Numbering Plan (NANP). Thus, 
the phone number 65 0-493 -#### would be associated with "Palo Alto, California". 
Similarly, 650-592-#### would be associated with "San Carlos, California", 

This information may be directly present in the telephone identifying information 
provided to the voice portal 110, or may be ascertained from a local exchange routing 

25 guide (LERG). For international callers outside the NANP, similar types of telephone 
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identifying information can be mapped to locales within countries to the extent permitted 
by the particular numbering plan. 

The city-state combination may correspond to multiple locales for the purposes of 
the voice portal 1 10. For example, a county-wide or multi-city locale can be defined that 
encompasses multiple area code/exchange combinations. Thus, a single caller may be in 
multiple locales. 

Locale information can be further refined through the use of additional databases, 
e.g. city/state to zip code databases, street address to five digit zip code databases, reverse 
lookup databases that map phone numbers to street addresses, longitude-latitude 
conversion databases, and/or other databases that provide locale related information from 
telephone identifying information. Thus, for example, V and H coordinates might be 
determined using the telephone identifying information. Those can be further converted to 
a longitude and latitude to determine the locale. Alternatively, a reverse phone number 
database could be used to find a specific street address for the telephone identifying 
information. 

Examples of the uses for the locale information include: providing 
locale-appropriate lottery results, providing driving directions to a requested destination, 
providing locale-appropriate weather reports, providing locale-appropriate show times for 
movies other events, e.g. cultural, governmental, etc., traffic reports, yellow page listings, 
and/or providing other locale-related information. 

H. Time/Date Based Personalization 

Turning to step 504, the customization of content based on the time and/or date 
will now be described. The telephone identifying information includes information about 
the caller's locale independent of any user provided registration information. This 
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information can be derived from telephone routing tables that provide a descriptive name 
for each area code/exchange combination within the NANP. Thus, the phone number 650- 
493.#### would be associated with "Palo Alto, California" and thus the correct time zone, 
Pacific, could be selected as well. 

5 This time zone may be directly present in the telephone identifying information 

provided to the voice portal 1 10, or may be ascertained from the LERG. For international 
callers outside the NANP, similar types of telephone identifying information can be 
mapped to locales within countries to the extent permitted by the particular numbering 
plan. Thus, callers from United Kingdom numbers would be mapped to British Standard 

10 Time. 

The time zone information allows the voice portal 1 10 to customize the 
presentation of information based on the time in the caller's locale. Callers can use a single 
nationwide, or international, number to reach the voice portal 110, e.g. 800-###-####. The 
voice portal 110 will use the time zone information to adjust the content presented to each 
15 user. 

Thus, during the lunch hour, the voice portal 110 might report a stock quote to the 
user while on a Friday evening, the voice portal 110 might suggest a movie. For example, 
"It is Friday night, would you be interested in seeing a movie?" A "yes" response by the 
caller will lead to the presentation of a list that is both time and date adapted and locale 

20 appropriate. For example, a caller from Palo Alto at six o'clock p.m. on a Friday would 
hear about show times after six o'clock p.m. in his local area. 

If necessary, the voice portal 110 may connect the user to an appropriate 
transaction system to complete a user requested transaction such a the purchase of an 
airline ticket, a movie ticket, an audio CD, etc. However, in many instances, the voice 

25 portal 1 1 0 may be able to directly complete the transaction using the data connectivity 
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engine 220 and access to the Internet 106 and/or one more databases (e.g. the database 
226). This process can occur even if the caller has not explicitly provided the voice portal 
110 her/his home location or the current time. For example, this personalized content 
might be presented immediately at after step 304 of Figure 3 in step 306, 
5 Similarly, other time sensitive information can be presented such as airline 

schedules, cultural and other events, etc. Thus, for example a caller asking for flight times 
to New York from a 65 0-493 -#### telephone number might be prompted to select one of 
the three local airports: San Francisco International, San Jose International, and Oakland 
International, and then the flight times to New York after the current time in the Pacific 
1 0 time zone would be presented. 

Some additional examples include customizing the presentation of business reports 
based on whether or not the market is open; modifying the greeting prompt based on the 
time of day; and providing traffic information automatically during commute hours, but 
not at other times. 

15 I. Targeted Advertising 

Embodiments of the invention support the presentation of targeted advertising, or 
other content, to callers of the voice portal 1 10 as shown at step 508. The two primary 
types of targeted advertising supported by embodiments of the invention will be described. 
The different types of targeted advertising can be combined as well. 

20 1. Based Solely on Telephone Identifying Information 

Telephone identifying information can be used to reference demographic 
information about callers from a particular area. For example, if the telephone identifying 
information includes the calling number 650-493-####, corresponding to Palo Alto, 
California, general demographic information about callers from that particular region can 
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be used to target the advertising, or other content. Further, if a reverse lookup database is 
used, the phone number can, in some instances, locate specific demographic information 
for a given household, or caller. 

This personalization allows the targeting of advertising to qualified callers by the 
5 voice portal 112. For example, an advertiser of expensive luxury vehicles might request 
that its callers be qualified based on their income, or a particular psychographic attribute, 
e.g. fun-loving. In that case, the demographic profile corresponding to the telephone 
identifying information can be used to qualify the caller. Thus, callers from the relatively 
affluent city of Palo Alto, California might receive the advertising. Similarly, if a 
10 particular household meets the requirements based on a reverse lookup, those households 
can receive the advertising as well, 

2. Based on Profile 

Another source of information about the caller is the profile used by the shared 
database 112. This profile may indicate interests based on the explicit and implicit 

1 5 preferences, e.g. likes sports, and can be used in combination with the telephone 
identifying information to more closely tailor ads to the caller. 

For example, if the caller has added movie and entertainment information to 
her/his profile, either explicitly or implicitly, advertising related to movies and 
entertainment could be favored over other qualified advertising based on the caller's 

20 profile. Other examples include providing brokerage, and other financial services, 

advertisements to callers who fi*equently check stock quotes and/or have a customized 
stock list. 
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J. Adaptive Voice Character 

Turning to step 508, the customization of content through adaptive voice character 
will now be described. The telephone identifying information includes information about 
the caller's locale independent of any user provided registration information. The locales 
5 may be associated with one or more standard voice character settings, e.g. for dialect, and 
also idiomatic speech. Thus, callers from California may receive different prompts and a 
different dialect from the voice portal then callers from Florida. 

Similarly, the telephone identifying information may include information about the 
type of phone, e.g. pay phone, hospital phone, etc., that can be used to adjust the voice 
10 character, e.g. louder and slower speech. 

Additionally, the caller's speaking voice may be used to refine the voice character 
of the system. Thus, callers with speech patterns from a particular region of the country 
may find that after several verbal interactions with the voice portal, the content being 
presented at step 512 is being spoken using a voice character more suited to their own 
15 speech patterns. Similarly, in response to callers who request that information be repeated 
several times, the voice character for those callers may be slowed and played back louder. 
Additional examples include allowing users to select different voice actors, different 
background music and/or sound effects, control the verbosity of prompts, etc. 

K. Purchase Recommendations 
20 Turning to step 510, the customization of content through purchase suggestions. 

Based on the caller's profile — as retrieved through the telephone identifying information — 
and/or demographic information from other sources, e.g. locale based and/or reverse 
lookup, the system can make purchasing suggestions. 
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The suggestions could be based on the caller's locale and what others in that locale 
have purchased. In other embodiments, the suggestions may be based on the profile of the 
user relative to other user's purchases. In some embodiments, approaches such as 
collaborative filtering are used to generate recommendations. 

5 Examples of recommendations may include particular goods and services, e.g. 

flowers for Mom a few days before Mother's Day. Further, the exact suggestion may vary 
based on the caller's past habits, e.g. in the past you bought chocolates so this year 
chocolates might be suggested again. Alternatively, if many people from your locale are 
buying a particular book that might be suggested as well. The particular purchase 

1 0 recommendation may relate to goods and services offered independently, by, and/or in 
affiliation with the operator of the voice portal 1 10. 

T. Voice Login 

As discussed above, the system may support the use of one or more passwords, 

either spoken or touch-tone for login and authentication purposes. The passwords provide 
1 5 for protection against modifications to a user' s profile without authentication. 

Additionally, certain specific actions, e.g. making a purchase, listening to certain types of 

personalized content, etc., may require authentication. 

Typically, the authentication system will support either a voice or a touch-tone 

password for users of the voice portal 110. This flexibility addresses sitiiations where the 
20 voice password is not working due to line conditions and/or conditions of the calling 

telephone. Products such as Nuance Verifier™ and/or other voice login and verification 

products may be used to provide the voice login feature. In some embodiments, both types 

of authentication may be required. 
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Once logged in, or authenticated, embodiments of the invention may minimize the 
need for the user to re-authenticate herself/himself, as described above. Additionally, the 
password, either voice and/or touch-tone, used for authentication for telephone sessions 
may be the same or different as any passwords used for authentication for web access to 
5 the profile customization options described in conjunction with Figure 4, 

M. Automatic Profile Initialization 

As discussed in conjunction with Figure 3, it may be desirable to initialize the 

profile using the telephone identifying information. The telephone identifying information 

can be used to select an appropriate demographic profile and list of topics based on the 
10 calling locale. In other embodiments, a reverse lookup of the calling number provided with 

the telephone identifying information is used to obtain a specific demographic profile for a 

caller and/or her/his household. 

Then the demographic information derived from the locale and/or the reverse 

lookup are used to set initial profile values. For example, the user's income might be 
15 estimated based on the average income for the calling locale, e.g. Palo Alto, California, or 

from demographic information from the reverse lookup. Similarly, the caller's initial topics 

might be selected based on commonly selected topics for her/his locale and/or the 

preferences available based on the demographic information retrieved by the reverse 

lookup. 

20 These initial values may be revised based on a caller's later actions. For example, if 

the initial estimate of a caller's age is too high, later actions may cause that information to 
be revised. Similarly, callers may be permitted to explicitly provide certain types of 
demographic information as needed. For example, the user might provide her/his birth 



C.\NRPORTBL\PALibl\DRH\n04973 4 



37 



Attorney Docket Number 22379-701 



date to a horoscope feature provided by the voice portal 1 10, in that instance, the birth date 
might be incorporated into the profile. 

N. Electronic Commerce Features 

The preceding discussion has focused on personaUzation of content for users 
5 accessing the voice portal 110. This section describes special commerce features within 
various embodiments of the invention. A transcript from a possible interaction between a 
user ("C") and the voice portal 110 ("S") will be provided. The transcript will be discussed 
segment by segment. In some instances, phrases will be included between angle brackets, 
e.g. "o", in those cases an appropriate substitution with the indicated value(s) should be 
10 made. After the dialogue from the transcript is discussed the process will be described in 
greater detail with respect to Figure 6. 



1 . Sample Dialogue Transcript 



2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
17 
18 
19 
20 
21 
22 
23 
24 



S 
S 

s 
s 
s 
c 
s 
s 
c 
s 
c 
s 
c 
s 
c 
s 
c 
s 
c 
s 
c 
s 
c 
s 



<Introductioti> 

<Optional Sponsorship> 

You can interrupt the system at any time. 

If you need assistance, say "help". 

Main Menu. Options: stocks, news, personal or travel. 

Travel. 

Welcome to the flight reservations system. 

What city would you like to depart from? San Francisco, Oakland, or San Jose? 
San Francisco. 

San Francisco. What city are you flying to? 
Las Vegas. 

Las Vegas. On what date would you hke to depart? 
June first. 

June first. Around what time would you like to depart? 
7pm 

Seven p m. How many travelers? 



one 



One traveler. Will this be rovmd trip or one way? 
Round trip 

Roimd trip. On what day would you like to return? 
June seventh 

June seventh. Around what time would you like to return? 
Nine a m 

Nine a m. One moment while I locate flights. 



Transcript Segment 1 
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Turning to the first segment of the transcript. The voice portal 110 introduces itself 
to the user at lines 1-5. Notice that sponsorship information can be inserted into the 
conversation, e.g. line 2, For example, the voice portal might offer a personalized 
advertisement, see above, at line 2. The sponsorship might also be personalized topically 

5 based on the subject matter of the purchase, e.g. travel. 

In this example, the user is attempting to purchase an airline ticket. The user lives 
in Palo Alto, California, and so the personalization features of the system described above 
allow the system at line 8 to prompt the user with the most likely departure airports. Thus, 
the personalization features are easily combinable with the commerce features of 

10 embodiments of the invention. In appropriate circumstances, the list provided might be 
adjusted based on the user's present location as opposed to the user's home. For example, 
if the user were to call from a pay phone in Washington, D.C, the airports in the D.C. area 
might be listed in addition to, or instead of, the San Francisco area airports. 

At lines 9-24 of the transcript, the user provides information to clarify her/his 

15 purchase requests. Airhne tickets require a more elaborate dialogue than say music CDs 
because there is more information to specify. 

In contrast, if at line 6 the user said, "Music", and that was a valid option, the 
system might ask for the artist or album name. Then, the user might be prompted to select 
from a short list of found items. For example, the user might say "98 Degrees" and the 

20 system might offer "There are three albums fi-om 98 Degrees, please select 98 Degrees, 98 
Degrees and Rising, or 98 Degrees Christmas." Upon selecting one or more of those 
albums, the conversation could then continue. 
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Continuing with the transcript for the airHne ticket purchase: 



25 S <Airline> is offering a special fare of $248 for flights to Las Vegas in June. To hear more 

about this offer, say "<Airline>'*. To hear a list of other flights, say "more flights". 

26 C <Akline> 

27 S <Airline> flight 2315, departs San Francisco on June 1st, at 7:14 p.m. and arrives in Las 

Vegas at 9:50 p.m. The return flight is <Airline> flight 7006, departing Las Vegas on June 
7*^, at 8:40 a.m., and arriving in San Francisco at 10:10 p.m. 

28 S To reserve this <Airline> flight, say "reserve it". To hear a Hst of other flights, say "more 

flights". 

29 C Reserve it, 

30 S Your <Airline> flight has been reserved. Your <Airline> confirmation number is 

<Confinnation Number>. 

3 1 S Remember, that you can view details of this transaction, as well as others, at 

voiceportal.com. 

32 S To purchase this ticket, please say "purchase", say "hold" to hold the reservation for 

twenty-four hours. 

33 C Purchase 

Transcript Segment 2 

Lines 25 through 33 of the transcript show the recommendation and reservation process. 
At line 25, the system is generating a recommendation. This recommendation may be 
based on a match between the user's requested schedule and the best fare for that schedule. 

5 Additionally, other preferences could be taken into account. 

For example, between lines 24 and 25 of the dialogue, the system could access the 
user profile to determine that the user prefers to fly Southwest Airlines. That preference 
may be derived from either an imphcit, or explicit, personalization, see above. As a result, 
the recommendation generated at line 25 may be based on that preference and as a result 

10 Southwest Airhnes flights might be suggested first. 

Also, between lines 29 and 30 of the dialogue the voice portal 110 can access the 
user profile corresponding to the telephone identifying information to assist in completing 
the transaction. More specifically, the user's full name, address, shipping information, 
credit card number, and/or other personal information can be retrieved from the user's 

1 5 profile. Also, embodiments of the invention can support other types of payments than 
credit cards, most generally any form of payment identifier can be used, e.g. automated 
check clearinghouse (ACH) information, electronic currency, credit card numbers, smart 
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card payment certificate, and/or other suitable forms of payment and identification of that 

payment can be used. 

This information can then be provided to the merchant to complete the transaction. 
If the information is not available in the user's profile, it can be obtained from the user. 
5 Users need not be re-prompted for information already in their profile, even for new 

merchants. Thus, if the user's full name and address are in the profile, no questions would 
have to be asked at this point of the example dialogue because only a name and address 
are needed to reserve an airline ticket. 

In contrast, if that information was not known, the voice portal 110 could 
10 interactively obtain the necessary information prior to continuing at line 30 of the dialogue 
and reserving the ticket. If necessary, or appropriate, a human operator may be brought on 
the line to receive the information and update the user's profile. Typically, voice and/or 
touch tone responses may be used in conjunction with information about the user's calling 
locale as derived from telephone identifying information to update the information without 
1 5 the assistance of a human operator. 

Once the user's profile contains adequate information to complete the required 
function, e.g. reserve an airline ticket, the voice portal 110 can complete the task. This 
might be done by accessing a database (e.g. the database 228) belonging to the airline over 
the Internet 106, or some other network or communication channel For example, the 
20 reservation database for Southwest Airlines might be accessed directly using electronic 
data interchange (EDI) format, extensible markup language (XML), and/or some other 
protocol. Those same protocols may have been used to obtain the flight information from 
the database at line 25 of the dialogue. 

In other instances, the execution engine 202 and the data connectivity engine 220 
25 may access a web site 230, or a web server, and perform the necessary transactions. 

^ vi 1 Attorney Docket Number 22379-701 
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Specifically, the voice portal could respond to the purchase command by executing a 
request to a server using the HTTP protocol or the secure hypertext transfer protocol 
(HTTPS). The secure socket layers (SSL) protocol can be used to ensure the privacy and 
security of the transaction. For example, if Southwest Airlines has a web site (e.g. the web 
5 site 230) that supports electronic commerce using SSL, HTTPS and/or HTTP, the data 

connectivity engine 220 could supply the requisite information to the web site 230 to place 
a reservation and/or purchase tickets. 

In these situations, the data connectivity engine 220 and the voice portal 110 acts 
in a similar fashion to a user's web browser. The voice portal 110 accesses the web site 
10 230 for the user and provides information in appropriate fields from the user's profile. This 
interaction with a web site may occur while the user waits or in the background, with 
confirmation provided to the user at a later point. 

In some instances, one or more web site descriptions may be developed to allow 
access by the data connectivity engine 220 to web sites for commerce purposes. The web 
1 5 site description may describe how to search for products and services. For example, a 
uniform resource indicator (URI) for the search engine and the format for search queries 
for a particular web site (e.g. the web site 230) might be included. The web site description 
may also specify how to parse search results. The web site descriptions may specify how 
to initiate a purchase transaction and as well as a mapping between user profile 
20 information and fields on the web site's forms. The web site description may specify how 
to parse confirmation and transaction resuhs. The web site descriptions allow the data 
connectivity engine 220 to act as an automated agent for the user. Further, they also allow 
for the generation of a cross-merchant record of all purchases made with the voice portal 
110, e.g. a voice receipt. Notification of the creation of a voice receipt is shown in line 3 1 
25 of the sample transcript. These voice receipts may be accessible over the web as suggested 
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by line 31 of the dialogue. Voice receipts may also be reviewed directly within the voice 
portal 1 10 in some embodiments of the invention. 

The voice receipt may contain information about a purchase, e.g. product/service, 
description, time of purchase, merchant/vendor/provider name, price paid, credit card 
5 used, order number, confirmation number, status - e.g. on backorder, shipped, 24 hours to 
purchase, awaiting trade execution, etc. - and/or other information relating to the 
transaction. 

Notably, the status information may be obtained through dynamic access to one or 
more merchant data sovirces. For example, if the voice receipt was for a trading request, 

10 the status information might be obtained from the brokerage company's computer systems 
by the data connectivity engine 220. The voice receipts offer a powerful management tool 
to users for tracking purchases made using the voice portal at multiple merchants. As in 
the case of this airline example, the voice receipt may include helpful information, e.g. the 
confirmation number, in a secure easily accessible location, obviating the need to 

1 5 manually record it with pen and paper at the time of the transaction. 

In this example with airline tickets, a distinction is made between reserving the 
tickets and purchasing them. This distinction is specific to this type of product because 
airlines allow customers to reserve tickets for twenty-four hours before purchasing them. 



At lines 31-33 of the dialogue, the user requests the purchase of the airline ticket. 



34 S 


In order to complete this transaction using one your credit cards on file, we need to confirm 
your identity. Please speak or touch-tone your password. If you prefer to use a different 
credit card, please speak or touch-tone that credit card nimiber now. 


35 C 


<Password> 


36 S 


We have confirmed your identity. Which credit card would you like to use? <Cardl> 
<Card2>, or <Card3> 


37 C 


<Card2> 


38 S 


Thank you, now processing your transaction. 


39 S 


<Musical Interlude> 


40 S 


Your ticket has now been purchased using your <Card2> credit card. You can review details 
of this transaction as well as others at voiceportal.com or by requesting "Receipts" from the 
main menu. 



Transcript Segment 3 
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In this example, this is the first transaction for this telephone session, as such the 
voice portal 1 10 requests password confirmation from the user before allowing the 
purchase to be completed. In some embodiments of the invention, the user is prompted for 
a password for all purchases. In other embodiments, a password is only requested for the 
5 first purchase in each telephone session. In other embodiments, the password is requested 
a single time in each session for all purposes. In some embodiments of the invention, users 
of wireless telephones may, as a default setting, not be required to provide a password 
since it is assumed that the wireless telephone is not shared by multiple users. 

The ability to quickly reference credit card information already on file improves 
10 transaction speed by eliminating the need for the user to re-provide information. This same 
approach can be used to select shipping addresses. For example, the system might prompt, 
"Do you want this order sent to your billing address, home address or work address?" to 
allow the user to select a shipping address for delivery of products. 

The commerce model employed by the voice portal 1 10 is designed to allow 
1 5 purchases using a single command, "Purchase", or similar phrases. In other words, the 
neither a password, a credit card selection, need be required from the user. Thus, the user 
input must specify a product selection and the user must issue the 'Turchase" command. 

Accordingly, the voice portal need not maintain a shopping cart, or similar 
construct for a user, store, or session. Further, the commerce model of the voice portal 110 
20 is independent of the commerce model used by any merchant. Thus, the voice portal 1 10 
may enable its users to buy items from web sites that use a shopping cart model using the 
one word purchase commerce model of the voice portal 110. Thus, the purchase of 
multiple CDs at a music store by a user of the voice portal 110 can each be treated as 
separate purchases. Further, for each CD, all order information may be provided to the 
25 merchant by the voice portal 1 10 as outhned above. 
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The order fulfillment process used by a given merchant may group related 
purchases from a user over a predetermined time period, e.g. session, day, week, month, 
etc. For example, the voice portal 1 10 might combine all CD purchases made in a single 
session into a single order in the merchant's computer systems. Alternatively, the merchant 
may combine the separate orders for fulfillment purposes. 

Similarly, if desirable, the voice portal 1 10 may group distinct purchases fi-om a 
single merchant within a predetermined time period, e.g. session, day, week, month, etc., 
into a single voice receipt with, if appropriate, status information for the individual items 
and/or the group of items as a whole. 

Additionally, the voice portal 110 may support a number of additional electronic 
commerce features. For example, accessory services may be provided relative to a 
purchase, e.g. status change notifications for a product. For example, the voice portal 110 
might prompt, "For twenty-five cents, we can notify you if your flight is delayed or 
changed, say 'notify me', to request this service." Similarly, the voice portal 110 might 
prompt, "For ten cents, we can send you an alpha-numeric page when your trade is 
executed, say 'page me', to request this service." 

In some instances, there may be no charge for the accessory service. The accessory 
service may be available irrespective of whether a particular merchant/vendor supports a 
feature. For example, a brokerage firm might provide e-mail trade confirmations. 
However, the voice portal 110 may use its interface to the brokerage systems to 
independently provide other features, e.g. pager notification. 

Similarly, the voice portal 110 may recommend related products, e.g. cross-sell. So 
in the example above of purchasing hotel tickets to Las Vegas, the system dialogue might 
prompt the user: "Our records indicate that <Convention> is being held in Las Vegas 
during your stay and hotel availability is low, would you like to book a hotel room now?" 
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If the user says yes, the dialogue can unfold much as it did for the purchase of the airUne 
ticket. 

2. Process Detail 

Figure 6 is a process flow diagram for conducting electronic commerce over a 
telephone interface according to some embodiments of the invention. The process of 
Figure 6 could be used by the voice portal 1 10 to provide electronic commerce over a 
telephone interface. Throughout the discussion of Figure 6, it will be assumed that the user 
has been identified by the voice portal 1 10, as in Figure 1, e.g. using the telephone 
identifying information 1 14. Alternatively, some embodiments of the invention may use 
alternative means to identify the caller to the voice portal, e.g. an explicit login process. 

First, at step 600, an audio request is received to initiate a transaction. This request 
may take the form of the user requesting a specific topic within the voice portal 110, e.g. 
travel, stock trading, music store, etc, or a more specific request, e.g. the user might say '1 
want to buy the new CD from 98 Degrees." Other audio input formats, including 
touch-tone are possible. 

Next, at step 602, the voice portal 110 conducts an audio dialogue with the user to 
more specifically identify the product or service they wish to purchase. For the purposes of 
this discussion, a product will be considered either a product or a service. For example, if 
the user has entered the travel category, a dialogue like the example above for airline 
tickets might unfold. In contrast, in music, or some other type of, store, the user might be 
prompted to provide search terms, or other product identifiers. Once, the voice portal 110 
has identified a product with sufficient specificity, any of steps 604-608 may occur. Steps 
604-608 may occiir in parallel, in sequence, based on user requests, and/or asynchronously 
in the background. 



C:\NRPORTBL\P ALib 1\DRH\ 1 1 04973 .4 



46 



Attorney Docket Number 223 79-70 1 



For example, the user might automatically be presented a recommendation at step 
606, e.g. a specific product like the CD "98 Degrees and Rising" or the specially priced 
airline ticket. Meanwhile, price comparisons for that product at different merchants could 
occur in the background at step 604. Also, a list of 
5 The dialogue process of step 602 and the processes of steps 604-608 may occur 

iteratively until the user has identified a product she/he wishes to purchase. Thus in the 
airline ticket purchase example above, if the user was not satisfied with the 
recommendation, the user could request a list of flights at step 608. If she/he was still not 
satisfied, she/he could return to step 602 and adjust her/his request. 

10 At step 610, a purchase confirmation is received from the user for the identified 

product. The confirmation from the user typically takes the form of a single word or 
command phrase such as "Purchase" or "Buy If, or a similar phrase. Because the user's 
identifying information is already available based on the associated profile for the 
telephone identifying information, it is not necessary to input names, addresses, and credit 

1 5 card numbers typically. If telephone identifying information is unavailable, then the user 
may be required to login and identify herself/himself However, the provision of address 
information and credit card information, etc., would still be automated. 

Periodically, for security purposes a password, or other identifier, may be 
requested from the user in conjunction with step 610, For example, the first purchase of 

20 each telephone session might require a password identifier. 

At step 612, the order is then placed with the merchant. The order may be placed 
through a number of electronic means. Notably, the order may be placed directly through a 
general purpose electronic commerce web site (e.g. the web site 230) using SSL and/or 
HTTPS with the voice portal 110 acting as a browser on behalf of the user. The voice 

25 portal 1 10 can fill out forms on the web site using information from the user profile. In 
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other embodiments, XML, EDI, and/or other proprietary or non-proprietary formats are 
used to place the order with the merchant. These same techniques can be used at steps 
604-608 to access information about products and services available for sale. Thus, it is 
not necessary for merchants to specially design their electronic commerce sites to support 

5 the voice portal 1 10 or the purchase model used by the voice portal 110. However, for 
efficiency reasons a particular web site may provide a custom mechanism for the voice 
portal 1 10 to conduct commerce via HTTP, HTTPS and/or SSL as well as a custom data 
exchange format for obtaining information and placing orders. 

Additionally, a voice receipt can be generated for the transaction at step 612. The 

10 voice receipt includes information about the transaction as described above. When 

appropriate, status information can be included as part of the voice receipt. The status 
information can be dynamically obtained from the appropriate merchant for inclusion in 
the voice receipt when it is reviewed. For example, an order for CDs might have shipping 
status information extracted directly from the merchant at the time the voice receipt is 

1 5 reviewed. The voice receipts may be reviewed on a web site for the voice portal 1 10 
and/or on the voice portal 110 itself, e.g. over the telephone 

The process of Figure 6 omits data collection steps that may, in some instances, be 
necessary to complete certain types of orders. For example, basic information such as 
name, address, shipping address, and credit card number are needed for many transactions. 

20 That information can be collected as needed for various purposes throughout the entire 
voice portal 110. Thus, an earlier request for driving directions may have provided the 
user's address to the voice portal 1 10. As part of step 610, additional data can be collected 
either using audio input and output to a computer or to a human operator. The user of the 
voice portal 110 may not even be aware that a human operator is receiving her/his input 

25 for entry into her/his profile. In addition, reverse lookup information can be used to derive 
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the user's name and address or assist in verification of the user's input. The voice portal 
110 minimizes the need for re-entry of data by maximizing usage of user profile 
information across different merchants/vendors. 

Still other embodiments of the invention allow a user to signal on a web site to 

5 have the vendor contact them to complete the transaction by telephone. This may allow for 
better support of customers who are uncomfortable making purchases over the Internet 
and/or make it easier for customers to make purchases from new vendors. For example, if 
Jane Doe already has a profile established with the voice portal 110, then she can 
circumvent the purchase process at a particular merchant by clicking on a link to have the 

1 0 voice portal 110 call her. In some instances, the user may be asked to provide her/his 
phone number on the web site. 

Still other information that is needed may be product/service specific, e.g. type of 
seating, pant size, etc. That information may be obtained as part of the dialogue at step 602 
and/or stored as user preferences by the voice portal 110. 

15 In some embodiments of the invention, a list of items may be presented to a user, 

e.g. a top n list of books, music, etc. The voice portal 110 may pause briefly between items 
in the list to receive a purchase request, e.g. "Buy It" or a touch-tone signal Thus, the 
purchase model is extended to handle purchases from a list of items. This may also be 
helpful when the user has requested a search and wants to purchase one of the items 

20 provided in the result list. 

O. Conclusion 

Thus, the voice portal 1 10 can serve as a telephone to HTTP, HTTPS, and/or SSL 
gateway for commerce purposes. Further, the voice portal 1 10 supports a one word 
purchase commerce model that greatly reduces the overhead of completing transactions 
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with multiple vendors using the telephone interface. Further, the model abstracts the 
particular purchase/transaction/vending model used by the vendor in favor of a uniform 
interface provided by the voice portal 110, Typical embodiments of the invention may 
support one or more words, phrases, or DTMF signals for use as the purchase command in 

5 the one word purchase model. 

A number of different personalization features provided by embodiments of the 
invention have been described, those features can be combined in a number of ways to 
provide personalized commerce services. 

In some embodiments, voice portal 1 10 can be hardware based, software based, or 

1 0 a combination of the two. In some embodiments, voice portal 1 1 0 is comprised of one or 
more computer programs that are included in one or more computer usable media such as 
CD-ROMs, floppy disks, or other media. In some embodiments, call manager programs, 
execution engine programs, data connectivity engine programs, evaluation engine 
programs, streaming subsystem programs, recognition server programs, and/or text to 

1 5 speech programs are included in one or more computer usable media. 

Some embodiments of the invention are included in an electromagnetic wave form. 
The electromagnetic waveform comprises information such as call manager programs, 
execution engine programs, data connectivity engine programs, evaluation engine 
programs, streaming subsystem programs, recognition server programs, and/or text to 

20 speech programs. The electromagnetic waveform may include the programs accessed over 
a network. 

The foregoing description of various embodiments of the invention has been 
presented for pxirposes of illustration and description. It is not intended to limit the 
invention to the precise forms disclosed. Many modifications and equivalent arrangements 
25 will be apparent. 
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CLAIMS 

What is claimed is: 



1 1 . A method of providing an electronic commerce transaction from the Internet to a 

2 telephone using a computer system, the computer system including a telephone interface 

3 system coupled in communications with an Internet access system, the telephone interface 

4 system being coupled in communications with the telephone, the method comprising: 

5 receiving an audio purchase request over the telephone interface system, the audio 

6 pxirchase request corresponding to a product for sale from a merchant, the 

7 merchant providing electronic commerce on the Internet using a second 

8 computer system; 

9 responsive to the audio purchase request, performing the following 

10 sending a first request to the second computer system over the Internet access 

1 1 system, the first request corresponding to a request for information about 

12 the product, 

1 3 receiving a first response from the second computer system over the Internet 

14 access system, the first response corresponding to an information about the 

15 product, 

1 6 providing an audio response over the telephone interface system, the audio 

17 response corresponding to the information, and 

1 8 receiving an audio confirmation over the telephone interface system; and 

19 responsive to the audio confirmation, performing the following 

20 sending a second request to the second computer system over the Internet 

21 access system, the second request corresponding to a request to purchase 

22 the product from the merchant; 
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23 receiving a second response from the second computer system over the Internet 

24 access system, the first response corresponding to a confirmation of the 

25 first request; and 

26 providing a second audio response over the telephone interface system, the 

27 second audio response indicating completion of the electronic commerce 

28 transaction. 

1 2. The method of claim 1 , wherein the telephone interface system receives a 

2 telephone identifying information, the method further comprising: 

3 accessing a user profile corresponding to the telephone identifying information, the 

4 user profile corresponding to information about a user; and 

5 including information from the user profile in at least one of the first request and 

6 the second request. 

1 3 . The method of claim 2, wherein the user profile includes at least one of a name, an 

2 address, a credit card number, a credit card expiration date, an electronic mail address, and 

3 a telephone number. 

1 4. The method of claim 2, wherein the user profile includes information obtained 

2 fi-om a reverse directory lookup on the telephone identifying information. 

1 5 . The method of claim 2, further comprising: 

2 providing a third audio request over the telephone interface system, the third audio 

3 request corresponding to a request for at least one of a name, an address, a 

4 credit card number, a credit card expiration date, an electronic mail address, 

5 and a telephone number; 
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6 



receiving an audio information response over the telephone interface system, the 



7 



audio information response corresponding to at least one of a name, an address, 



8 



a credit card number, a credit card expiration date, an electronic mail address. 



9 



and a telephone number; and 



10 



including the corresponding at least one of a name, an address, a credit card 



11 



number, a credit card expiration date, an electronic mail address, and a 



12 



telephone number in the user profile. 



1 6. The method of claim 2, wherein the second computer system includes a web server 

2 providing an HTML order form, and wherein the second request comprises HTML form 

3 data corresponding to information from the user profile. 

1 7. The method of claim 2, wherein the second computer system includes a web server 

2 supporting an HTTP protocol, and wherein the second request comprises data 

3 corresponding to information from the user profile sent using the HTTP protocol. 

1 8. The method of claim 1 , wherein the Intemet access system supports access to the 

2 second computer system using one or more of a secure sockets layer (SSL) protocol, a 

3 hypertext transfer protocol (HTTP), and a secure hypertext transfer protocol (HTTPS). 

1 9. The method of claim 8, wherein the second request includes at least one of 

2 hypertext markup language (HTML) data and extensible markup language (XML) data 

3 sent to the second computer system using HTTPS. 

1 10. The method of claim 8, wherein the second computer system includes a web server 

2 providing an HTML order form, and wherein the second request comprises HTML form 

3 data corresponding to an order for the product. 
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1 11. The method of claim 1 , further comprising responsive to the second response, 

2 generating a voice receipt, the voice receipt corresponding to information about the 

3 electronic commerce transaction. 

1 12. The method of claim 1 1 , wherein the voice receipt includes at least one of a name 

2 of the product, a description of the product, a name of the merchant, a contact information 

3 for the merchant, a price paid for the product, an order number, a confirmation number, 

4 and a status. 

1 13. The method of claim 1 1 , v^herein the voice receipt includes a status, the status 

2 corresponding to information retrieved from the second computer system about the 

3 electronic commerce transaction. 

1 14. The method of claim 1 1 , further comprising: 

2 receiving an audio request, the audio request corresponding to a request to review 

3 the voice receipt; and 

4 responsive to the audio request, providing a second audio response over the 

5 telephone interface, the second audio response corresponding to information 

6 from the voice receipt. 

1 15. The method of claim 1 , wherein the receiving the audio purchase request 

2 comprises receiving a verbal request for a product, performing voice recognition on the 

3 verbal request to determine the product. 

1 16. The method of claim 1 , wherein the receiving the audio purchase request 

2 comprises receiving a series of one or more touch tone signals and decoding the series of 

3 one or more touch tone signals to determine the product. 
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1 17. The method of claim 1 , wherein the receiving the audio purchase request 

2 comprises receiving a verbal request for a merchant, performing voice recognition on the 

3 verbal request to determine the merchant. 

1 18, The method of claim 1 , wherein the receiving the audio purchase request 

2 comprises receiving a series of one or more touch tone signals and decoding the series of 

3 one or more touch tone signals to determine the merchant. 

1 19. A method of providing an electronic commerce transaction from the Internet to a 

2 telephone using a computer system, the computer system including a telephone interface 

3 system coupled in communications with an Internet access system, the telephone interface 

4 system being coupled in communications with the telephone, the method comprising: 

5 receiving an audio request over the telephone interface system, the audio request 

6 corresponding to a product for sale from a merchant, the merchant providing 

7 electronic commerce on the Internet using a second computer system; 

8 responsive to the audio request, performing the following 

9 sending a first request to the second computer system over the Internet access 

1 0 system, the first request corresponding to a request for information about 

1 1 the product, 

12 receiving a first response from the second computer system over the Internet 

1 3 access system, the first response corresponding to an information about the 

14 product, 

15 providing an audio response over the telephone interface system, the audio 

1 6 response corresponding to the information, and 

17 receiving a confirmatory audio request over the telephone interface system; and 
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1 8 responsive to the confirmatory audio request, performing the following 

1 9 sending a second request to the second computer system over the Internet 

20 access system, the second request corresponding to a request to purchase 

2 1 the product from the merchant; 

22 receiving a second response from the second computer system over the Internet 

23 access system, the first response corresponding to a confirmation of the 

24 first request; and 

25 providing a second audio response over the telephone interface system, the 

26 second audio response indicating completion of the electronic commerce 

27 transaction. 

1 20. The method of claim 19, vv^herein the telephone interface system receives a 

2 telephone identifying information, the method further comprising: 

3 accessing a user profile corresponding to the telephone identifying information, the 

4 user profile corresponding to information about a user; and 

5 including information from the user profile in at least one of the first request and 

6 the second request. 

1 21, The method of claim 20, wherein the user profile includes at least one of a name, 

2 an address, a credit card number, a credit card expiration date, an electronic mail address, 

3 and a telephone number. 

1 22. The method of claim 20, wherein the user profile includes information obtained 

2 from a reverse directory lookup on the telephone identifying information, 

1 23 . The method of claim 20, further comprising: 
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2 providing a third audio request over the telephone interface system, the third audio 

3 request corresponding to a request for at least one of a name, an address, a 

4 credit card number, a credit card expiration date, an electronic mail address, 

5 and a telephone number; 

6 receiving an audio information response over the telephone interface system, the 

7 audio information response corresponding to at least one of a name, an address, 

8 a credit card number, a credit card expiration date, an electronic mail address, 

9 and a telephone number; and 

1 0 including the corresponding at least one of a name, an address, a credit card 

1 1 number, a credit card expiration date, an electronic mail address, and a 

12 telephone number in the user profile. 

1 24. The method of claim 20, wherein the second computer system includes a web 

2 server providing an HTML order form, and wherein the second request comprises HTML 

3 form data corresponding to information from the user profile, 

1 25. The method of claim 20, wherein the second computer system includes a web 

2 server supporting an HTTP protocol, and wherein the second request comprises data 

3 corresponding to information from the user profile sent using the HTTP protocol. 

1 26. The method of claim 19, wherein the Internet access system supports access to the 

2 second computer system using one or more of a secure sockets layer (SSL) protocol, a 

3 hypertext transfer protocol (HTTP), and a secure hypertext transfer protocol (HTTPS). 

1 27. The method of claim 26, wherein the second request includes at least one of 

2 hypertext markup language (HTML) data and extensible markup language (XML) data 

3 sent to the second computer system using HTTPS. 
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1 28. The method of claim 26, wherein the second computer system includes a web 

2 server providing an HTML order form, and wherein the second request comprises HTML 

3 form data corresponding to an order for the product. 

1 29. A computer system to provide an electronic commerce transaction from the 

2 Internet to a telephone, the computer system comprising: 

3 an Internet interface including at least one program to access a second computer 

4 system using one or more of a SSL protocol, a HTTP, and a HTTPS; 

5 a telephone interface to send and receive audio signals to and from the telephone 

6 and to receive a telephone identifying information corresponding to the 

7 telephone; and 

8 a control subsystem to control the Internet interface and the telephone interface, the 

9 control subsystem including at least one program for 

1 0 processing an audio request to purchase a product from a merchant, the 

1 1 merchant providing electronic commerce on the Internet using the second 

1 2 computer system, and 

1 3 completing the electronic commerce transaction for the product with the 

14 merchant over the Internet interface responsive to an audio confirmation. 

1 30. The computer system of claim 29, wherein the at least one program in the control 

2 subsystem further for accessing a user profile corresponding to the telephone identifying 

3 information, the user profile corresponding to information about a user and wherein the 

4 completing further comprises providing at least a portion of the user profile to the 

5 merchant over the Intemet interface. 
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1 31. The computer system of claim 29, wherein the at least one program in the control 

2 subsystem further for generating a voice receipt responsive to the completing, the voice 

3 receipt corresponding to information about the electronic commerce transaction. 

1 32. A computer system performing an electronic commerce transaction over a 

2 telephone, the computer system receiving a telephone identifying information associated 

3 with the telephone, the electronic commerce transaction performed over the Internet, the 

4 computer system comprising: 

5 means for receiving an audio request to initiate the electronic commerce 

6 transaction; 

7 means for selecting a product from a merchant using an audio dialogue, the 

8 merchant providing electronic commerce on the Intemet using a second 

9 computer system; 

10 means for receiving audio confirmation of the electronic conomerce transaction of 

1 1 the product; and 

12 means for completing the electronic commerce transaction over the Intemet with 

13 the second computer system. 

1 33 . The computer system of claim 32, wherein the means for completing further 

2 comprises: 

3 means for accessing a user profile corresponding to the telephone identifying 

4 information, the user profile corresponding to information about a user; 

5 means for providing at least a portion of the user profile to the second computer 

6 system over the Intemet to complete the electronic commerce transaction. 
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1 34, The computer system of claim 32, further comprising means for providing a voice 

2 receipt of the electronic commerce transaction, the voice receipt corresponding to a record 

3 of the electronic commerce transaction. 

1 35. The computer system of claim 32, wherein the means for selecting comprises: 

2 means for comparing prices for the product at a plurality of merchants; 

3 means for providing a list of a predetermined number of merchants from the 

4 plurality of merchants over the telephone, the predetermined number of 

5 merchants offering the product at a lower price than other merchants in the 

6 plurality of merchants; and 

7 means for receiving an audio selection of one of the merchants in the list, the 

8 selection corresponding to the merchant, 

1 36. A method of ordering an item over a telephone, the telephone coupled to a 

2 computer system by a telephone interface, the computer system supporting access to an 

3 Intemet for completing commerce transactions, the method comprising: 

4 presenting information about the item in audio format over the telephone interface 

5 using the computer system; and 

6 responsive to a single audio response received by the computer system over the 

7 telephone interface: 

8 retrieving telephone identifying information associated with the telephone to 

9 identify a profile associated with the purchaser; and 

10 sending a request to order the item, the request including information from the 

1 1 profile about the purchaser to a second computer system on the Internet, the 

12 second computer system operated by a merchant selling the item. 
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1 37. The method of claim 36, wherein the request is sent to the second computer system 

2 over the Internet using a secure hypertext transfer protocol (HTTPS) and the request 

3 includes a payment identifier from the user profile. 

1 38. The method of claim 36, wherein the profile includes at least one of a name, an 

2 address, a credit card number, a credit card expiration date, an electronic mail address, and 

3 a telephone number. 

1 39. The method of claim 36, wherein the profile includes information obtained from a 

2 reverse directory lookup on the telephone identifying information. 

1 40. The method of claim 36, wherein the second computer system includes a web 

2 server providing an HTML order form, and wherein the request to order the item 

3 comprises HTML form data corresponding to information from the profile. 

1 4 L The method of claim 36, wherein the second computer system includes a web 

2 server supporting an HTTP protocol, and wherein the request to order the item comprises 

3 data corresponding to information from the profile sent using the HTTP protocol. 

1 42. The method of claim 36, wherein computer system communicates with the second 

2 computer system over the Intemet using one or more of a secure sockets layer (SSL) 

3 protocol, a hypertext transfer protocol (HTTP), and a secure hypertext transfer protocol 

4 (HTTPS), 

1 43 . The method of claim 42, wherein the request to order the item includes at least one 

2 of hypertext markup language (HTML) data and extensible markup language (XML) data 

3 sent to the second computer system using HTTPS. 
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1 44. The method of claim 42, wherein the second computer system includes a web 

2 server providing an HTML order form, and wherein the request to order the item 

3 comprises HTML form data corresponding to an order for the product. 

1 45. The method of claim 36, further comprising after the request to order the item, 

2 generating a voice receipt, the voice receipt corresponding to information about the order 

3 of the item. 

1 46. The method of claim 45, wherein the voice receipt includes at least one of a name 

2 of the item, a description of the item, a name of the merchant, a contact information for the 

3 merchant, a price paid for the item, an order number, a confirmation number, and a status. 

1 47. The method of claim 45, wherein the voice receipt includes a status, the status 

2 corresponding to information retrieved from the second computer system about the order 

3 of the item. 

1 48, A method of completing a purchase of an item over a telephone, the telephone 

2 coupled to a first computer system by a telephone interface, the first computer system 

3 supporting access to an Internet, the method comprising: 

4 receiving a signal from a second computer system over the Internet, the signal 

5 corresponding to a request to place a telephone call to a user at a telephone 

6 number to complete the purchase of the item; 

7 calling the user over the telephone at the telephone number using the telephone 

8 interface using the first computer system; 

9 conducting an audio dialogue over the telephone interface with the user using the 
10 first computer system to obtain at least one of a name, an address, a credit card 
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1 1 number, a credit card expiration date, an electronic mail address, a telephone 

12 number, a confirmation of the purchase, and a password; and 

1 3 completing the purchase of the item by sending a message to the second computer 

14 over the Internet, the message including at least a portion of personal 

1 5 identifying information obtained in the audio dialogue. 

1 49. The method of claim 48, wherein the conducting the audio dialogue comprises: 

2 identifying a user profile associated with the telephone number; 

3 making an audio request, the audio request corresponding to a request for a 

4 password from the user; 

5 receiving an audio response, the audio response corresponding to a password from 

6 the user; and 

7 wherein the completing occurs responsive to verification of the password provided 

8 by the user against the password in the user profile. 

1 50. A method of completing a purchase from a list over a telephone, the telephone 

2 coupled to a first computer system by a telephone interface, the telephone supplying 

3 telephone identifying information to the first computer system over the telephone 

4 interface, the first computer system supporting access to an Internet, the list including a 

5 plurality of items, the method comprising: 

6 identifying a user profile associated with the telephone identifying information; 

7 using the computer to present each of the plurality of items in the list over the 

8 telephone interface; and 

9 responsive to an audio response, completing a purchase of a most recently 

1 0 presented item on a second computer system coupled in communication with 

1 1 the first computer system over the Internet using the user profile. 
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1 51. The method of claim 50, wherein a pause of a predetermined amount of time is 

2 inserted between the presentation of each item. 

1 52. A method of storing information received over a telephone interface in a data 

2 storage coupled to a computer, the telephone coupled to the computer by a telephone 

3 interface, the method comprising: 

4 using the computer to prompt a user for information over the telephone interface; 

5 receiving an audio signal over the telephone interface; 

6 sending the audio signal from the computer to an audio interface, the audio 

7 interface for presenting the audio signal to a human; 

8 receiving a data signal on the computer, the data signal corresponding to a speech 

9 recognition result for the audio signal by a human; and 

10 responsive to receiving the data signal, updating the data storage to include the 

1 1 speech recognition result. 

1 53. The method of claim 52, wherein the speech recognition result indicates that the 

2 human could not process the audio signal, the method further comprising repeating the 

3 method until the speech recognition result no longer indicates that the human could not 

4 process the audio signal. 
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ABSTRACT 

A voice portal supporting telephone to web server commerce is described. The 
voice portal allows users to access web servers using a hypertext transfer protocol 
(HTTP), optionally including the use of a secure sockets layer (SSL) protocol, to complete 
commercial transactions. Additionally, embodiments of the invention can employ a one 
word commerce model that abstracts the particular model used by various electronic 
commerce vendors' web sites. The one word commerce model permits a user to identify a 
product and signal her/his purchase intentions with a single word, phrase, or touch-tone 
command. The voice portal can then complete the transaction supplying the electronic 
commerce vendor necessary information about the purchaser, e.g. her/his address, 
telephone number, electronic mail address, credit card information, etc. As needed, the 
voice portal can prompt the purchaser for information. Because the voice portal can 
maintain a record of this information independent from a particular vendor, the collected 
information can be automatically be re-used when making purchases from other vendors. 
Further, embodiments of the invention can provide a record of commerce transactions in 
the form of voice receipts. The voice receipts can include vendor specific status 
information. Selective password protection of the commerce features are afforded by some 
embodiments of the invention to reduce the likelihood of unauthorized transactions. 
Additionally, embodiments of the invention may employ a range of personalization 
techniques to assist purchasers in selecting items as well as in the presentation of 
suggested items. 
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COMBINED DECLARATION AND POWER OF ATTORNEY 
FOR UTILITY PATENT APPLICATION 

As a below-named inventor, I hereby declare that: 

My residence, post office address and citizenship are as stated below next to my 

name; 

I believe I am the original, first and sole inventor (if only one name is listed below) or 
an original, first and joint inventor (if plural names are listed below) of the subject matter 
which is claimed and for which a patent is sought on the invention entitled: 

METHOD AND APPARATUS FOR ELECTRONIC COMMERCE 
USING A TELEPHONE INTERFACE 

the specification of which 

X is attached hereto. 

was filed on as Application No. 

and was amended on t • 

(If Applicable) 

I hereby state that I have reviewed and understand the contents of the above-identified 
specification, including the claims, as amended by any amendment referred to above. 

I acknowledge the duty to disclose information which is material to the examination 
of this application in accordance with Titie 37, Code of Federal Regulations, §1.56(a) which 
states in relevant part: "Each individual associated with the filing and prosecution of a patent 
application has a duty of candor and good faith in dealing with tiie Office, which includes a 
duty to disclose to the Office all information known to that individual to be material to 
patentability as defined in this section....The duty to disclose all information known to be 
material to patentability is deemed to be satisfied if all information known to be material to 
patentability of any claim issued in a patent was cited by the Office or submitted to the Office 
in the manner prescribed by §§ 1.97(b)-(d) and 1.98." 

I hereby claim foreign priority benefits under Titie 35, United States Code, §119 of 
any foreign application(s) for patent or inventor's certificate as indicated below and have also 
identified below any foreign application for patent or inventor's certificate on this invention 
having a filing date before that of the application on which priority is claimed: 

Prior Foreign Application(s) Priority Claimed 



(Number) (Country) (Day/MonthA'ear Filed) Yes 
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I hereby claim the benefit imder Title 35, United States Code, §120 of any United 
States application(s), and under § 119(e) of any United States provisional application(s), listed 
below and, insofar as the subject matter of each of the claims of this application is not 
disclosed in the prior United States application in the manner provided by the first paragraph 
of Title 35, United States Code, §1 12, 1 acknowledge the duty to disclose material 
information as defined in Title 37, Code of Federal Regulation, §L56(a) which occurred 
between the filing date of the prior application and the national or PCT international filing 
date of this application: 

09/426.102 October 22. 1999 Pending 

(Application Serial No,) (Filing Date) (Patented, Pending, Abandoned) 



(Application Serial No.) (Filing Date) (Patented, Pending, Abandoned) 

I hereby appoint the following attorney(s) and/or agent(s) to prosecute this application 
and transact all business in the Patent and Trademark Office connected therewith, and to file, 
prosecute and to transact all business in connection with international applications directed to 
said invention: 
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Kent R. Richardson 

Wilson Sonsini Goodrich & Rosati 

650 Page Mill Road 

Palo Alto, CA 94304 

Direct all telephone calls to Kent R. Richardson at (650) 493-9300. 



Paul Davis 
John J. Bruckner 
David J. Weitz 
Kent R. Richardson 
U.P. Peter Eng 
Barbara Courtney 
Richard L, Gregory, Jr, 
Van Mahamedi 
Shantanu Basu 
Shaalu Mehra 
Stephen Warhola 
Shirley Chen 
Joel Harris 



29,294 
35,816 
38,362 
39,443 
39,666 
42,442 
42,607 
42,828 
43,318 
44,934 
43,237 
44,608 
44,743 
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I hereby declare that all statements made herein of my own knowledge are true and that 
all statements made on information and belief are believed to be true; and further that these 
statements were made with the knowledge that willful false statements and the like so made 
are punishable by fine or imprisonment, or both, under Title 18, United States Code, §1001 
and that such willful false statements may jeopardize the validity of the application or any 
patent issued thereon. 



Full name of sole or 
first inventor: 

Inventor's signature: 

Date: 

Citizenship: 

Residence: 

Post Office Address: 



Hadi Partovi 



United States 



2280 Green Street #104. San Francisco. California 94123 
Same As Above 



Full name of second joint 
inventor, if any:: 

Inventor's signature: 

Date: 

Citizenship: 

Residence: 

Post Office Address: 



Roderick Steven Brathwaite 



United States 



490 Andrews Street. Livermore. California 94550 



Same As Above 



Full name of third joint 

inventor, if any: : 
Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 



Angus Macdonald Davis 



United States 



991 The Dalles Avenue, Sunnyvale. California 94087 
Same As Above 
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Full name of foxnth joint 

inventor, if any:: 
Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 



Michael S. McCue 



United States 



400 Surmont Road. Los Gatos. California 



Same As Above 



Full name of fifth joint 

inventor, if any:: 
Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 



Brandon WilUam Porter 



United States 



840 E. Dana Street. Momtain View. Calfiomia 94041 
Same As Above 



Full name of sixth joint 

inventor, if any:: 
Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 



John Giannandrea 



Great Britain 



977 Commercial Street. Palo Alto. California 94303 



Same As Above 



Full name of seventh joint 

inventor, if any: : Eckart Walther 

Inventor's signature: 

Date: 

Citizenship: Germany 

Residence : 150 Doherty Way. Redwood Citv. California 94061 

Post Office Address: Same As Above 
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Full name of eighth joint 

inventor, if any:: 
Inventor's signature: 
Date: 

Citizenship: 
Residence: 

Post Office Address: 



Eugene Koh 



United States 

1021 Paradise Wav 

Palo Alto. California 94306 
Same As Above 



Full name of ninth joint 

inventor, if any:: 
Inventor's signature: 
Date: 

Citizenship: 

Residence: 

Post Office Address: 



Andv Scott 



United States 



1440 Union St.. #307. San Francisco. CA 94109 



Same As Above 
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